BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home]
[Evaluation Methods]
[Master Result Table]
[Team Profiles]
[System Profiles]
Final Evaluation Results
on REG-TOTAL events by Ev. Decom. - Approx. Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[REG-TOTAL]== 1940 ( 672) 1409 ( 672) 34.64 47.69 40.13
[ConcordU ] ==[REG-TOTAL]== 1940 ( 583) 1041 ( 583) 30.05 56.00 39.11
[JULIELab ] ==[REG-TOTAL]== 1940 ( 666) 1724 ( 666) 34.33 38.63 36.35
[UT+DBCLS ] ==[REG-TOTAL]== 1940 ( 521) 1168 ( 521) 26.86 44.61 33.53
[VIBGhent ] ==[REG-TOTAL]== 1940 ( 375) 952 ( 375) 19.33 39.39 25.93
[ UNSW ] ==[REG-TOTAL]== 1940 ( 350) 962 ( 350) 18.04 36.38 24.12
[ UZurich ] ==[REG-TOTAL]== 1940 ( 322) 806 ( 322) 16.60 39.95 23.45
[ UTokyo ] ==[REG-TOTAL]== 1940 ( 288) 757 ( 288) 14.85 38.04 21.36
[ Cam ] ==[REG-TOTAL]== 1940 ( 212) 455 ( 212) 10.93 46.59 17.70
[UAntwerp ] ==[REG-TOTAL]== 1940 ( 226) 678 ( 226) 11.65 33.33 17.27
[ SCAI ] ==[REG-TOTAL]== 1940 ( 265) 1269 ( 265) 13.66 20.88 16.52
[ Team 24 ] ==[REG-TOTAL]== 1940 ( 192) 801 ( 192) 9.90 23.97 14.01
[CNBMadrid] ==[REG-TOTAL]== 1940 ( 352) 3662 ( 352) 18.14 9.61 12.57
[ NICTA ] ==[REG-TOTAL]== 1940 ( 152) 751 ( 152) 7.84 20.24 11.30
[ UMich ] ==[REG-TOTAL]== 1940 ( 314) 3886 ( 314) 16.19 8.08 10.78
[ UAveiro ] ==[REG-TOTAL]== 1940 ( 128) 494 ( 128) 6.60 25.91 10.52
[ASU+HU+BU] ==[REG-TOTAL]== 1940 ( 106) 257 ( 106) 5.46 41.25 9.65
[CIPS-ASU ] ==[REG-TOTAL]== 1940 ( 204) 2405 ( 204) 10.52 8.48 9.39
[ USzeged ] ==[REG-TOTAL]== 1940 ( 85) 379 ( 85) 4.38 22.43 7.33
[ UNIMAN ] ==[REG-TOTAL]== 1940 ( 80) 400 ( 80) 4.12 20.00 6.84
[CCP-BTMG ] ==[REG-TOTAL]== 1940 ( 56) 115 ( 56) 2.89 48.70 5.45
[ Team 09 ] ==[REG-TOTAL]== 1940 ( 46) 343 ( 46) 2.37 13.41 4.03
[ PIKB ] ==[REG-TOTAL]== 1940 ( 23) 59 ( 23) 1.19 38.98 2.30
[ KoreaU ] ==[REG-TOTAL]== 1940 ( 12) 32 ( 12) 0.62 37.50 1.22
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[REG-TOTAL]== 1994 ( 527) 1180 ( 527) 26.43 44.66 33.21
[UAntwerp ] ==[REG-TOTAL]== 1994 ( 234) 698 ( 234) 11.74 33.52 17.38
[ Team 24 ] ==[REG-TOTAL]== 1994 ( 203) 819 ( 203) 10.18 24.79 14.43
[CNBMadrid] ==[REG-TOTAL]== 1994 ( 370) 4285 ( 370) 18.56 8.63 11.79
[ASU+HU+BU] ==[REG-TOTAL]== 1994 ( 106) 257 ( 106) 5.32 41.25 9.42
[CCP-BTMG ] ==[REG-TOTAL]== 1994 ( 56) 115 ( 56) 2.81 48.70 5.31
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------